منابع مشابه
A generalized Markov decision process
— In this paper we present a generalized Markov décision process that subsumes the traditional discounted, infinité horizon, finite state and action Markov décision process, VeinotCs discountéd décision processes, and Koehler's generalization of these two problem classes. Résumé. — Nous présentons dans cet article un processus de Markov généralisé qui englobe le processus de décision markovien ...
متن کاملMonopoly as a Markov Process
The limit frequencies of the positions in the game of Monopoly are calculated on the basis of Markov chains. In order to make the process Markovian some minor modifications in the rules are necessary. A parameter is introduced so that by varying this parameter we can determine how distorted our mode is compared with the actual game. The convergence properties of Markov chains are so nice that i...
متن کاملMarkov process applied to degradation modelling
.................................................................................................................... 2 Preface ....................................................................................................................... 3 Acknowledgements................................................................................................... 4 Chapter 1: Introduction .........
متن کاملMarkov-chain approach to a process with long-time memory
We show that long-term memory effects, present in the chaotic dispersion process generated by a meandering jet model, can be nonetheless taken into account by a first order Markov process, provided that the states of the phase space partition, chosen to describe the system, be appropriately defined.
متن کاملA Markov Process Based Approach to Effective Attacking JPEG Steganography
In this paper, a new steganalysis scheme is presented to effectively detect the advanced JPEG steganography. For this purpose, we first choose to work on JPEG 2-D arrays formed from the magnitudes of JPEG quantized block DCT coefficients. Difference JPEG 2-D arrays along horizontal, vertical and diagonal directions are then used to enhance changes caused by JPEG steganography. Markov process is...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Acta Mathematica
سال: 1969
ISSN: 0001-5962
DOI: 10.1007/bf02392389